Evaluation of the National Institutes of Health-Supported Relative Citation Ratio Among Fellowship-Trained American Orthopaedic Joint Reconstruction Surgery Faculty: A New Bibliometric Measure of Scientific Influence.

BACKGROUND: The relative citation ratio (RCR), a novel National Institutes of Health-Supported measure of research productivity, allows for accurate interdisciplinary comparison of publication influence. This study evaluates the RCR of fellowship-trained adult reconstructive orthopaedic surgeons with the goal of analyzing potentially influential physician demographics. METHODS: Adult Reconstruction Accreditation Council for Graduate Medical Education fellowship-trained faculty for orthopaedic residency programs were identified via departmental websites. The National Institutes of Health's iCite database was retrospectively reviewed for mean RCR, weighted RCR, and publication count by surgeon. Multivariate analyses were performed using the Wilcoxon rank-sum tests and analyses of variance testing to compare sex, career length, academic rank, and professional degrees in addition to an MD or DO. Significance was considered P < .05. RESULTS: A total of 488 fellowship-trained adult reconstruction faculty from 144 programs were included in the analysis. Overall, the faculty recorded a median RCR of 1.65 (interquartile range: 1.01-2.28) and a median weighted RCR of 16.59 (interquartile range: 3.98-61.92). The weighted RCR and total number of publications were associated with academic rank and career longevity, while the mean RCR was associated with academic rank. The median RCR ranged from 1.12 to 1.87 for all subgroups. CONCLUSION: Adult reconstruction faculty are exceptionally productive and generate highly impactful studies as evidenced by the high median RCR value relative to the National Institutes of Health standard value of 1.0. Our data have important implications in the assessment of grant outcomes, promotion, and continued evaluation of research influence within the hip and knee community.

Evaluation of the National Institutes of Health-supported relative citation ratio among American Shoulder and Elbow Surgeons fellowship faculty: a new bibliometric measure of scientific influence.

BACKGROUND: Publication metrics are used to evaluate and compare research productivity among academic faculty. However, traditional bibliometrics, such as the Hirsch index and article citation count, are limited by lack of field-normalization and yield inaccurate cross-specialty comparisons. Herein, we evaluate the use of a new field-normalized article-level metric developed by the National Institutes of Health (NIH), known as the relative citation ratio (RCR), among American Shoulder and Elbow Surgeons (ASES) fellowship faculty and analyzed physician factors associated with RCR values. METHODS: A retrospective data analysis was performed using the iCite database for all shoulder and elbow surgery fellowship faculty listed on the American Shoulder and Elbow Surgeons (ASES) directory as of November 14, 2021. Mean RCR, weighted RCR, and total publication count were compared by sex, career duration, academic rank, and presence of additional degrees. Mean RCR represents the total number of article citations per year of a publication divided by the average number of citations per year received by NIH-funded papers in the same field; mean RCR serves as a measure of overall research impact. A value of 1.0 is the NIH-funded field-normalized standard. The weighted RCR represents the sum of all article-level RCR scores and is a measure of overall research productivity. Student t tests were used for two-group analyses whereas analyses of variance were used for between-group comparisons of 3 or more subgroups. RESULTS: A total of 145 ASES fellowship faculty members from 33 fellowship programs were included in the analysis. Overall, ASES fellowship faculty produced highly impactful research with a median RCR of 1.8 (interquartile range [IQR] 1.4-2.3) and a median weighted RCR of 67.0 (IQR 21.1-212.7). Advanced academic rank and career longevity were associated with increased weighted RCR and total publication count. All subgroups analyzed had an RCR value above 1.0. CONCLUSIONS: ASES fellowship faculty are exceptionally productive and produce highly impactful research, as evidenced by the high median RCR value relative to the benchmark NIH RCR value of 1.0. This information can be used as a standard to assess the improvement of grant outcomes, promotion, fellowship education, and continued evaluation of research productivity in the shoulder and elbow community.